A database of whole-body action videos for the study of action, emotion, and untrustworthiness

We present a database of high-definition (HD) videos for the study of traits inferred from whole-body actions. Twenty-nine actors (19 female) were filmed performing different actions—walking, picking up a box, putting down a box, jumping, sitting down, and standing and acting—while conveying different traits, including four emotions (anger, fear, happiness, sadness), untrustworthiness, and neutral, where no specific trait was conveyed. For the actions conveying the four emotions and untrustworthiness, the actions were filmed multiple times, with the actor conveying the traits with different levels of intensity. In total, we made 2,783 action videos (in both two-dimensional and three-dimensional format), each lasting 7 s with a frame rate of 50 fps. All videos were filmed in a green-screen studio in order to isolate the action information from all contextual detail and to provide a flexible stimulus set for future use. In order to validate the traits conveyed by each action, we asked participants to rate each of the actions corresponding to the trait that the actor portrayed in the two-dimensional videos. To provide a useful database of stimuli of multiple actions conveying multiple traits, each video name contains information on the gender of the actor, the action executed, the trait conveyed, and the rating of its perceived intensity. All videos can be downloaded free at the following address: http://www-users.york.ac.uk/~neb506/databases.html. We discuss potential uses for the database in the analysis of the perception of whole-body actions

Take an Emotion Walk: Perceiving Emotions from Gaits Using Hierarchical Attention Pooling and Affective Mapping

We present an autoencoder-based semi-supervised approach to classify perceived human emotions from walking styles obtained from videos or motion-captured data and represented as sequences of 3D poses. Given the motion on each joint in the pose at each time step extracted from 3D pose sequences, we hierarchically pool these joint motions in a bottom-up manner in the encoder, following the kinematic chains in the human body. We also constrain the latent embeddings of the encoder to contain the space of psychologically-motivated affective features underlying the gaits. We train the decoder to reconstruct the motions per joint per time step in a top-down manner from the latent embeddings. For the annotated data, we also train a classifier to map the latent embeddings to emotion labels. Our semi-supervised approach achieves a mean average precision of 0.84 on the Emotion-Gait benchmark dataset, which contains both labeled and unlabeled gaits collected from multiple sources. We outperform current state-of-art algorithms for both emotion recognition and action recognition from 3D gaits by 7%--23% on the absolute. More importantly, we improve the average precision by 10%--50% on the absolute on classes that each makes up less than 25% of the labeled part of the Emotion-Gait benchmark dataset.Comment: In proceedings of the 16th European Conference on Computer Vision, 2020. Total pages 18. Total figures 5. Total tables

Signature Movements Lead to Efficient Search for Threatening Actions

The ability to find and evade fighting persons in a crowd is potentially life-saving. To investigate how the visual system processes threatening actions, we employed a visual search paradigm with threatening boxer targets among emotionally-neutral walker distractors, and vice versa. We found that a boxer popped out for both intact and scrambled actions, whereas walkers did not. A reverse correlation analysis revealed that observers' responses clustered around the time of the “punch", a signature movement of boxing actions, but not around specific movements of the walker. These findings support the existence of a detector for signature movements in action perception. This detector helps in rapidly detecting aggressive behavior in a crowd, potentially through an expedited (sub)cortical threat-detection mechanism

Man and the Last Great Wilderness: Human Impact on the Deep Sea

The deep sea, the largest ecosystem on Earth and one of the least studied, harbours high biodiversity and provides a wealth of resources. Although humans have used the oceans for millennia, technological developments now allow exploitation of fisheries resources, hydrocarbons and minerals below 2000 m depth. The remoteness of the deep seafloor has promoted the disposal of residues and litter. Ocean acidification and climate change now bring a new dimension of global effects. Thus the challenges facing the deep sea are large and accelerating, providing a new imperative for the science community, industry and national and international organizations to work together to develop successful exploitation management and conservation of the deep-sea ecosystem. This paper provides scientific expert judgement and a semi-quantitative analysis of past, present and future impacts of human-related activities on global deep-sea habitats within three categories: disposal, exploitation and climate change. The analysis is the result of a Census of Marine Life – SYNDEEP workshop (September 2008). A detailed review of known impacts and their effects is provided. The analysis shows how, in recent decades, the most significant anthropogenic activities that affect the deep sea have evolved from mainly disposal (past) to exploitation (present). We predict that from now and into the future, increases in atmospheric CO2 and facets and consequences of climate change will have the most impact on deep-sea habitats and their fauna. Synergies between different anthropogenic pressures and associated effects are discussed, indicating that most synergies are related to increased atmospheric CO2 and climate change effects. We identify deep-sea ecosystems we believe are at higher risk from human impacts in the near future: benthic communities on sedimentary upper slopes, cold-water corals, canyon benthic communities and seamount pelagic and benthic communities. We finalise this review with a short discussion on protection and management methods